Transforming data to create layouts

ABSTRACT

Concepts and technologies are described herein for transforming data to create layouts. In accordance with the concepts and technologies disclosed herein, a computing device can execute a layout generator. The computing device can be configured to receive or retrieve data that includes visual content such as an image and other content such as text. The computing device can analyze the visual content to identify a salient region and/or an invariant region within the visual content. The computing device can access designs for laying out visual content and other content based upon an identified salient region and/or invariant region. The computing device can evaluate the designs to determine if a design matches the data. The computing device can load the data into the selected design to generate the layout.

BACKGROUND

Various application programs, modules, or other types of software can beused to publish visual content or other information. As such, datasharing has become commonplace among software users. With respect tovisual content in particular, users sometimes wish to publish visualcontent with other types of content such as text or other information ina single published document. For example, users may wish to create aflyer, a layout, a pamphlet, a website, an advertisement, a socialnetworking update, an image, or the like, that includes visual contentas well as other content such as text.

Because many users are not well-versed in design concepts that can beused to present the data in a meaningful format for viewers, the datapublished by these users may not be readily consumable and/or understoodby viewers. Additionally, visual content sometimes is published quicklywithout consideration of how the data may best be provided to consumersof the data. As such, formats chosen to present visual content or otherdata may or may not be ideal. In particular, the published content maylack a format that allows the data to be useful for viewers. As such,challenges exist for publishers and/or consumers of visual content dueto the increasing volume and frequency of publication of this type ofcontent, and the challenges of presenting the visual content in ameaningful way.

It is with respect to these and other considerations that the disclosuremade herein is presented.

SUMMARY

Concepts and technologies are described herein for transforming data tocreate layouts. In accordance with the concepts and technologiesdisclosed herein, a device, an application, or a technology layerprovided by hardware and/or software within a computing device cancorrespond to or provide functionality associated with a layoutgenerator. In some embodiments, a computing device executes a layoutgenerator. Via execution of the layout generator, the computing devicecan be configured to receive, retrieve, or otherwise obtain data. Thedata can include visual content such as images and other content such astext. The computing device can analyze at least one image included inthe data to identify a salient region associated with the image. In someembodiments, the computing device also can be configured to analyze theimage to identify an invariant region associated with the image.

As used herein, the term “salient region” can be used to refer to aportion of an image that includes what can be considered to be an“important” portion of the image. For example, if image includes people,the salient region can be determined to include one or more faces of thepeople in an image. Similarly, the salient region can be identified asbuildings in architectural photos, flowers or other vividly coloreditems among trees, grass, or other relatively monotonously-coloredbackgrounds, or the like. In some embodiments, the salient region can beidentified by the computing device based upon patterns, color variances,sharpness or blurring, facial recognition, or other processes. As such,the salient region can correspond to an area, region, or other portionof an image that can be determined to be a focal point or subject of theimage. Similarly, the term “invariant region” as used herein can be usedto refer to an area, region, or portion of the image that has arelatively consistent color, color scheme, color differences, luminance,sharpness, blur, pattern, or the like, that can be determined to be alocation at which text included in the data could be located withrespect to the image over the invariant region, achieving reasonable andconsistent contrast between the foreground text and the backgroundimage. In some examples, the invariant region can correspond to arelatively uniform portion of the image such as a blue sky in alandscape photograph, a wall or other background behind human subjects,or the like. Salient regions and invariant regions may or may not bemutually exclusive. For example, in some cases invariant regions can becontained within the salient regions or can overlap the salient regions.

The computing device can be configured to store or access one or morelayout designs (“designs”). The designs can be generated by designers orother entities and stored at a data storage device at or incommunication with the computing device. The designs can include aviewport frame that corresponds to and/or defines visible limits orextents of a layout or other output to be generated by the layoutgenerator. The designs also can include one or more salient regionplacement frames defining a location within the layout at which asalient region of the image is to be located. The designs also caninclude one or more text placement frames defining a location within thelayout at which text and/or an invariant region of the image is to belocated. The computing device can compare the analyzed data to one ormore designs to determine if the visual content and/or any text includedin the data match, or are conducive to the use of, one or more of thedesigns. A matching design, or a highest-ranked design if multiplematching designs are identified, can be selected. The computing devicecan load the data into the selected design to generate the layout.

Layout designs also can be automatically generated by the computingdevice based, at least partially, upon predefined rules such as anaspect ratio and/or size range of the viewport, locations and/or sizesof the salient regions frames, locations and/or sizes of the textplacement frames, or the like. For example, some rules can specifygenerating design layouts containing a viewport with aspect ratiosbetween 2 and 0.5 with five steps, with salient region frames of sizesbetween 0.1 to 0.5 of the viewport area located on the top, left, rightand/or bottom of the viewport. Numbers of possible permutations can beproduced via this process, which can be used in addition to or insteadof stored design layouts as described and illustrated herein. Ittherefore should be understood that the design layout generationembodiments described and illustrated herein are illustrative, andshould not be construed as being limiting in any way.

In generating the layout, the computing device can adjust a position ofthe image within the viewport frame such that a salient region of theimage is located within the viewport frame at a position thatcorresponds to a salient region placement frame associated with thedesign, effectively cropping the original image. Similarly, thecomputing device can adjust a position of the image within the viewportframe such that an invariant region of the image is located within theviewport frame at a position that corresponds to a text placement frameassociated with the design. The computing device can place the text atthe location of the text placement frame, and the computing device cangenerate or create the layout or other form of the output for viewing,printing, saving, publishing, or other activity. If the computing devicedoes not identify a design determined to be a match for the data, thecomputing device can scale, scroll, pan, or otherwise modify the imageto match one of the designs. In some embodiments, the computing deviceplaces the text at a location within the layout that does not overlaythe scaled image. As such, the computing device can generate a layoutwhether or not any designs match the salient region and/or invariantregion of the image.

It should be appreciated that the above-described subject matter may beimplemented as a computer-controlled apparatus, a computer process, acomputing system, or as an article of manufacture such as acomputer-readable storage medium. These and various other features willbe apparent from a reading of the following Detailed Description and areview of the associated drawings.

This Summary is provided to introduce a selection of concepts in asimplified form that are further described below in the DetailedDescription. This Summary is not intended to identify key features oressential features of the claimed subject matter, nor is it intendedthat this Summary be used to limit the scope of the claimed subjectmatter. Furthermore, the claimed subject matter is not limited toimplementations that solve any or all disadvantages noted in any part ofthis disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a system diagram illustrating an illustrative operatingenvironment for the various embodiments disclosed herein.

FIG. 2 is a line drawing illustrating an example image and theidentification of a salient region and/or an invariant region of theimage, according to an illustrative embodiment.

FIGS. 3A-3C are line drawings schematically illustrating aspects ofdesigns, according to various illustrative embodiments.

FIG. 4 is a flow diagram showing aspects of a method for creatinglayouts, according to an illustrative embodiment.

FIGS. 5A-5D are user interface diagrams showing aspects of userinterfaces for loading data into the designs to create the layouts,according to various illustrative embodiments.

FIG. 6 is a computer architecture diagram illustrating an illustrativecomputer hardware and software architecture for a computing systemcapable of implementing aspects of the embodiments presented herein.

FIG. 7 is a diagram illustrating a distributed computing environmentcapable of implementing aspects of the embodiments presented herein.

FIG. 8 is a computer architecture diagram illustrating a computingdevice architecture capable of implementing aspects of the embodimentspresented herein.

DETAILED DESCRIPTION

The following detailed description is directed to concepts andtechnologies for transforming data to create layouts. According to theconcepts and technologies described herein, a device such as a computingdevice can access or execute an application or technology layer thatprovides a layout generator. The computing device can obtain data thatincludes visual content such as images and other content such as text.The data can be obtained from an application or device at, incommunication with, and/or remote from the computing device. Thecomputing device can analyze one or more images included in the data toidentify a salient region of the image. The computing device also can beconfigured to analyze the image to identify an invariant regionassociated with the image.

The computing device can be configured to store or access one or moredesigns and to evaluate the designs to determine if one or more of thedesigns matches the data obtained by the computing device. The computingdevice can identify a matching design based upon the determined salientregion and/or invariant region of the image as well as locations withina matching design of a salient region placement frame and/or a textplacement frame. In some embodiments, the computing device can identifya single design that matches the data and in some other embodiments, thecomputing device can identify a number of designs that match the data.If multiple matching designs are identified, the matching designs can beranked and a highest-ranked design can be selected.

The computing device can be configured to load the data into theselected design to generate the layout. In generating the layout, thecomputing device can be configured to transform the data by cropping,scaling, panning, scrolling, extending, infilling, seam carving, and/orotherwise modifying visual content included in the data, as well asoverlaying the image with the text included in the data. If a designthat accommodates the visual content and the text cannot be identifiedby the computing device, the computing device can transform the data byscaling and/or shifting the image and placing the text outside of theimage to generate the layout. The generated layout can be output by thecomputing device for storage, viewing, publishing, or other uses.

While the subject matter described herein is presented in the generalcontext of program modules that execute in conjunction with theexecution of an operating system and application programs on a computersystem, those skilled in the art will recognize that otherimplementations may be performed in combination with other types ofprogram modules. Generally, program modules include routines, programs,components, data structures, and other types of structures that performparticular tasks or implement particular abstract data types. Moreover,those skilled in the art will appreciate that the subject matterdescribed herein may be practiced with other computer systemconfigurations, including hand-held devices, multiprocessor systems,microprocessor-based or programmable consumer electronics,minicomputers, mainframe computers, and the like.

In the following detailed description, references are made to theaccompanying drawings that form a part hereof, and in which are shown byway of illustration specific embodiments or examples. Referring now tothe drawings, in which like numerals represent like elements throughoutthe several figures, aspects of a computing system, computer-readablestorage medium, and computer-implemented methodology for transformingdata to create layouts will be presented.

Referring now to FIG. 1, aspects of one operating environment 100 forthe various embodiments presented herein will be described. Theoperating environment 100 shown in FIG. 1 can include a computing device102. According to various embodiments, the functionality of thecomputing device 102 can be provided by a personal computer (“PC”) suchas a desktop, tablet, workstation, or laptop computer system. Thefunctionality of the computing device 102 also can be provided by othertypes of computing systems including, but not limited to, servercomputers, handheld computers, netbook computers, notebook computers,embedded computer systems, personal digital assistants, mobiletelephones, tablet or slate computers, smart phones, or other devices orsystems capable of executing the various software elements describedherein. Because other computing systems can be used to provide thefunctionality described herein, the above examples of the computingdevice 102 should be understood as being illustrative and should not beconstrued as being limiting in any way.

According to some embodiments, the computing device 102 is configured tooperate in communication with, or as a part of, a communications network(“network”) 104. In some other embodiments, the computing device 102does not operate in communication with the network 104 and/orfunctionality of the computing device 102 described herein can beprovided without accessing the network 104. The computing device 102 canbe configured to execute an operating system 106 and one or moreapplication programs, modules, software elements, or othercomputer-executable or computer-executable instructions such as, forexample, a layout generator 108 and/or other computer-executableinstructions.

The operating system 106 is a computer program for controlling theoperation of the computing device 102. The layout generator 108 caninclude an executable program configured to execute on top of theoperating system 106 to provide the functionality described herein forcreating layouts. Although the layout generator 108 is illustrated as acomponent of the computing device 102, it should be understood that thelayout generator 108 may be embodied as or in a stand-alone device orcomponents thereof operating as part of or in communication with thenetwork 104 and/or the computing device 102. The layout generator 108also can be a virtualized service or technology layer that executes onthe computing device 102 and/or on other real or virtual devices incommunication with the computing device 102. Thus, the illustratedembodiment is illustrative, and should not be construed as beinglimiting in any way.

As will be explained in more detail below, the layout generator 108 canbe configured to obtain data 110. The data 110 obtained by the layoutgenerator 108 can include visual content such as one or more images,video, or the like, as well as other content such as text to bepresented with the visual content. For purposes of illustrating anddescribing the concepts and technologies disclosed herein, the visualcontent is referred to herein as “images.” Because types of visualcontent are contemplated and are possible, it should be understood thatthis embodiment is illustrative, and should not be construed as beinglimiting in any way.

The layout generator 108 can analyze at least one image included in thedata 110 to identify one or more salient regions of the image. As usedherein, the term “salient region” can be used to refer to a portion ofan image that is determined to be an important portion of the image, afocal point of the image, a subject of the image, or the like. Thelayout generator 108 can identify a salient region based upon colordifferences at, near, or within the salient region; color or texturepatters at, near, or within the salient region; facial recognition;object recognition; brightness and/or metering data; blurring orsharpness at, near, or within the salient region; color distributionsat, near, or within the salient region, or the like. For example, thelayout generator 108 can identify a salient region corresponding to aface in an image that includes a person. It should be understood that insome embodiments, the layout generator 108 can identify multiple salientregions in a particular image. Because other approaches for identifyingone or more salient regions are contemplated, it should be understoodthat these embodiments are illustrative, and should not be construed asbeing limiting in any way.

The layout generator 108 also can analyze at least one image to identifyone or more invariant regions of the image. The term “invariant region,”as used herein, can be used to refer to a portion of an image that isdetermined by the layout generator 108 to correspond to a locationconducive for text placement; to include constant or relatively(relative to other portions of the image) constant coloring, luminance,patterns, sharpness, brightness, contrast, textures; or the like. Forexample, if an image includes a subject such as a person or buildingsurrounded by a relatively solid color background such as a blue skywith wispy white clouds, a field, a wall, or the like, the layoutgenerator 108 may designate the background as an invariant region. Assuch, the background can correspond to a location within the image ontowhich text can be overlaid or located. In particular, the layoutgenerator 108 can be configured to place text at a locationcorresponding to the invariant region of the image such that the textcan be easy to read (relative to text placed on top of a varyingbackground or foreground). An example of identifying an invariant regionis set forth below in detail with reference to FIGS. 2 and 5A-5D.Because other approaches for identifying invariant regions arecontemplated, it should be understood that these embodiments areillustrative, and should not be construed as being limiting in any way.

The layout generator 108 can be configured to identify salient regionsand/or invariant regions within an image or other visual contentincluded in the data 110. The layout generator 108 also can beconfigured to generate, store, access, and/or use one or more designs112. The designs 112 can correspond to frames or guides for generatinglayout or output 114. In particular, the layout generator 108 can usethe designs 112 as rules or guides for transforming one or more imagesand one or more instances of text in the data 110 into a layout or otherform of the output 114. According to various embodiments, the designsinclude a viewport frame that can define visible limits or extents of alayout or other form of the output 114, one or more salient regionplacement frames that define a location within the layout or other formof the output 114 at which a salient region of the image is to belocated, and one or more text placement frames that define a locationwithin the layout or other form of the output 114 at which an invariantregion of the image and/or the text included in the data 110 is/are tobe located in the output 114.

The layout generator 108 can be configured to determine, based upon ananalysis of the data 110, one of the designs 112 into which the data 110can be loaded, and to create the output 114 by loading the data 110 intothe determined and/or selected design 112. As will be explained in moredetail herein, the designs 112 can include grid-based image and textdesign layouts that can be created to approximate a number ofcontemplated design scenarios. The layout generator 108 can beconfigured to determine, based upon the data 110, which of the designs112 is to be used to create the output 114 and/or how to modify the data110 if a design 112 is not identified for the data 110. If the layoutgenerator 108 identifies multiple designs 112 that can be used to createthe output 114, the layout generator 108 can be configured to rank thepossible designs 112 and select a highest-ranked design of the possibledesigns 112. The designs 112, the selection of a design 112, and theapplication of the data 110 to the chosen design 112 will be describedin more detail below, particularly with reference to FIGS. 2-5D.

According to various embodiments, the computing device 102 can beconfigured to create, generate, receive, and/or store the data 110. Forexample, the data 110 can be stored at the computing device 102 in amemory, disk drive, or other data storage elements. In some otherembodiments such as the embodiment illustrated in FIG. 1, the data 110can be obtained from a data source 116 that can be configured to operateas part of or in communication with the network 104. The functionalityof the data source 116 can be provided by a network drive, a servercomputer operating on or in communication with the network 104, adatabase or other real or virtual data storage elements, and/or otherdata storage devices. In some embodiments, wherein the layout generator108 operates a technology layer within the computing device 102, thedata 110 can be obtained from an application or storage device andloaded into or otherwise provided to the layout generator 108. As such,it should be understood that the illustrated and described embodimentsof the operating environment 100 are illustrative, and should not beconstrued as being limiting in any way.

According to various aspects of the concepts and technologies disclosedherein, the layout generator 108 can be included as part of one or moreapplications, programs, software, computer-executable instructions,and/or other data, or can be provided as a technology layer executing onthe computing device 102 and/or elsewhere to modify content generated bythe one or more instances of computer-executable instructions. Thevarious aspects of the layout generator 108 described herein can beprovided by a single or multiple applications or modules. Thus, thecomputing device 102 can, by execution of the layout generator 108,receive the data 110; determine a design 112 into which to load the data110; identify one or more salient region(s) and/or one or more invariantregion(s) within an image included in the data 110; load the data 110into the determined design, and generate the output 114.

Some or all of the designs 112 can be associated with or have associatedwith the designs 112 a set of rules for applying the data 110 to thedesigns 112. The rules can define how the data 110 is applied to aparticular design 112. As mentioned above, the rules can be embodied asa viewport frame, one or more salient region placement frames, and/orone or more text placement frames. The computing device 102 can beconfigured to load the data 110 into a selected design 112 based uponthe rules associated with the design 112. The computing device 102 canbe configured to display the output 114 for a user or other entity, orto store the output 114 at a data storage device, if desired.

According to some embodiments of the concepts and technologies disclosedherein, the computing device 102 also is configured to obtain and applyuser feedback to the designs 112 and/or to the output 114. In someembodiments, the computing device 102 can prompt for, and/or receivewithout prompting, user feedback. The feedback can include userresponses to various prompts or questions. For example, the computingdevice 102 can present questions to a user or other entity forevaluating various aspects of the output 114. In some embodiments, thecomputing device 102 asks or prompts a user or other entity for feedbackregarding layouts, text placement, scales and/or positions of images,element locations, image sizes, or other aspects of the output 114 byexpressing whether that particular aspect is liked or disliked. Basedupon the expressed likes and/or dislikes, the computing device 102 canbe configured to update the output 114 and/or to modify one or more ofthe designs 112. The computing device 102 also can be configured togenerate a new design 112 based upon the feedback, if desired.

It should be understood that the computing device 102 can prompt a userif a particular aspect of the output 114 is liked or disliked, good orbad, or the like. The feedback, questions, prompts, or the like can beformatted as questions with binary yes/no, like/dislike, or true/falseanswers. The questions or prompts also can request rankings over variousranges such as, for example, scales of numbers such as one to ten, oneto one hundred, letter grades such as “A” through “F,” numbers of stars,or the like. The user can provide this and/or other types of feedbackwith respect to the entirety of the output 114 and/or the computingdevice 102 can be configured to ask the user to express this feedbackregarding individual parts or components of the output 114. For example,the computing device 102 can be configured to ask if the output 114 isliked or disliked, or to ask if a particular aspect or component of theoutput 114 is liked or disliked. Because other approaches for expressinglikes and/or dislikes with respect to the output 114 are possible andare contemplated, it should be understood that these embodiments areillustrative, and should not be construed as being limiting in any way.

FIG. 1 illustrates one computing device 102, one network 104, and onedata source 116. It should be understood, however, that someimplementations of the operating environment 100 include multiplecomputing devices 102, multiple networks 104, zero or multiple datasources 116 and/or additional or alternative hardware elements. Thus,the illustrated embodiments should be understood as being illustrative,and should not be construed as being limiting in any way.

Turning now to FIG. 2, a line diagram showing aspects of an image andthe identification of a salient region and/or an invariant region willbe described according to an illustrative embodiment. FIG. 2 shows anillustrative sample image (“image”) 200. It should be appreciated thatthe image 200 illustrated in FIG. 2 is illustrative of one exampleembodiment, and therefore should not be construed as being limited inany way.

As shown in FIG. 2, the image 200 can include multiple people, faces, orother subjects (“people”) 202. It can be appreciated that the exampleimage 200 is provided only for purposes of illustration. As such, thepeople 202 are merely illustrative of one contemplated embodiment of animage subject, and should not be construed as being limiting in any way.Although not necessarily present in every instance of visual contentsuch as the image 200, the image 200 includes empty space areas (“emptyspace”) 204. As used herein, the term “empty space” can refer to spacewithin an image such as the image 200 that is not occupied (or is onlypartially occupied) by important or salient aspects of the image 200. Assuch, the empty space 204 can include, but is not limited to, aninvariant region of an image as described herein. For example, the emptyspace 204 can include a region or portion of the image 200 that hassubstantially constant coloring, color distribution, luminance,patterns, textures, sharpness, blurring, brightness, contract, or thelike. The above examples of identifying the empty space 204 should beunderstood as being illustrative and should not be construed as beinglimiting in any way.

In accordance with some embodiments of the concepts and technologiesdisclosed herein, the computing device 102 can be configured to identifythe people 200 and/or one or more portions thereof as corresponding to asalient region as described above. In particular, the faces 206 of thepeople 200 can be determined to correspond to a salient region of theimage 200 by the computing device 102 and/or the layout generator 108.In some embodiments, the computing device 102 can identify a region thatencompasses all of the faces 206, a portion of each of the faces 206,and/or a portion of one or more of the faces 206 as corresponding to thesalient region. It should be understood that this embodiment isillustrative, and should not be construed as being limiting in any way.

Similarly, the computing device 102 can identify one or more of theempty spaces 204 and/or portions thereof as corresponding to aninvariant region as explained above. Thus, the computing device 102 canbe configured to determine that an invariant region corresponding to theempty spaces 204 may be used for placement of text, or the like, whenthe layout or other form of the output 114 is generated. Several exampledesigns 112 and loading data into the designs 112 are illustrated anddescribed below in more detail with reference to FIGS. 3A-5D.

Turning now to FIGS. 3A-3C, additional aspects of the designs 112 areillustrated, according to some illustrative embodiments. According tovarious embodiments of the concepts and technologies disclosed herein, alibrary of designs 112 can be maintained and/or accessed by thecomputing device 102. The library of designs 112 can include any numberof designs 112. As such, the illustrated embodiments are provided onlyfor illustration of various aspects of the concepts and technologiesdisclosed herein and should not be construed as being limiting in anyway.

Referring to FIG. 3A, an example design 112 is schematically illustratedas having a grid-based layout design 300A. The grid-based layout design300A includes a viewport frame 302 that can correspond to the limits orextents of the desired layout. Thus, the viewport frame 302 cancorrespond to the viewable portion of the layout or other output 114generated by the layout generator 108. The grid-based layout design 300Aalso includes two salient region placement frames 304.

The salient region placement frames 304 can correspond to a placementarea, region, or location for a salient region of an image within theoutput 114 generated by the layout generator 108. Thus, the salientregion placement frames 304 can correspond to an area or region at whichthe salient region of an image is to be placed or located within avisible portion of a layout or other form of output 114. As mentionedabove, the visible limits of the layout or other form of the output 114can be defined by the viewport frame 302. The grid-based layout design300A is illustrated in FIG. 3A as including two salient region placementframes 304. It should be understood, however, that the designs 112 caninclude less than two salient region placement frames 304, two salientregion placement frames 304, and/or more than two salient regionplacement frames 304. As such, the illustrated embodiment should not beconstrued as being limiting in any way.

It further can be appreciated with reference to FIG. 3A that one or moreof the salient region placement frames 304 can extend out of theviewable space of the output 114 as defined by the viewport frame 302.During generation of the output 114, the image or other visual contentcan be panned, scrolled, moved, and/or otherwise located with respect tothe viewport frame 302 such that a portion of the salient region of theimage can be located at the location corresponding to one or more of thesalient region placement frames 304. As such, the image may be locatedwith respect to the viewport frame 302 such that a portion of the imagemay extend beyond the viewport frame 302.

Similarly, because an image can include more than one salient region, itshould be understood that the layout generator 108 can be configured toplace one or more salient regions of the image at one or more of thesalient region placement frames 304. As such, one or more of the salientregions of an image may or may not be placed at locations thatcorrespond to the salient region placement frames 304 shown in FIG. 3A.An example method for applying the data 110 to the design 112 andplacement of a salient region of an image included in the data 110 atthe salient region placement frames 304 is set forth below in moredetail in FIG. 4.

Referring now to FIG. 3B, another example design 112 is schematicallyillustrated as having a grid-based layout design 300B. The grid-basedlayout design 300B includes the viewport frame 302. It should beunderstood that while the viewport frame 302 is illustrated as beingrectangular and as having particular dimensions and/or a particulardimension ratio and/or orientation, that the viewport frame 302 can haveother shapes, other dimensions, other dimension ratios, and/or otherorientations. As such, the illustrated embodiment should not beconstrued as being limiting in any way.

As shown in FIG. 3B, the grid-based layout design 300B includes twosalient region placement frames 304, as described above. The grid-basedlayout design 300B also includes a text placement frame 306 that cancorrespond to an area, region, or other location within an image atwhich text is to be placed by the layout generator 108 during creationof the output 114. As can be appreciated from the above description ofthe concepts and technologies disclosed herein, the text placement frame306 can correspond to and/or overlap an invariant region that can beidentified by the layout generator 108, though this is not necessarilythe case.

The layout generator 108 can be configured to identify one or moreinvariant regions within an image and to locate the invariant regions ofthe image at or near the text placement frames 306, if desired.Similarly, the layout generator 108 can identify one or more salientregions of the image or other visual content, and can locate the one ormore salient regions at or near the salient region placement frames 304.The layout generator 108 also can place text at or near the textplacement frame 306. Although only one text placement frame 306 is shownin FIG. 3B, it should be understood that a design 112 can includemultiple text placement frames 306. As such, it should be understoodthat the illustrated embodiment is illustrative, and should not beconstrued as being limiting in any way.

Referring now to FIG. 3C, another example design 112 is schematicallyillustrated as having a grid-based layout design 300C. The grid-basedlayout design 300C can include the viewport frame 302. Again, it shouldbe understood that the illustrated dimensions, dimension ratio, and/ororientation are illustrative, and that the viewport frame 302 can haveother shapes, other dimensions, other dimension ratios, and/or otherorientations.

As shown in FIG. 3C, the grid-based layout design 300C includes twosalient region placement frames 304, as described above. As shown inFIG. 3C, the salient region placement frames 304 can be arranged suchthat one or more of the salient region placement frames 304 overlap oneanother in a particular design 112. Additionally, the grid-based layoutdesign 300C includes two text placement frames 306. As shown, one ormore of the text placement frames 306 can overlap one or more of thesalient region placement frame 304 in some designs 112. Although twosalient region placement frames 304 and two text placement frames 306are shown in FIG. 3C, it should be understood that a design 112 caninclude less than two salient region placement frames 304, two salientregion placement frames 304, more than two salient region placementframes 304, less than two text placement frames 306, two text placementframes 306, and/or more than two text placement frames 306. As such, itshould be understood that this embodiment is illustrative, and shouldnot be construed as being limiting in any way.

In operation of the layout generator 108, the data 110 can be receivedor retrieved at the computing device 102 for generation of a layout orother form of output 114. The layout generator 108 executed by thecomputing device 102 can analyze the data 110. During analysis of thedata 110, the layout generator 108 can determine if any text is to beincluded in the output 114. The layout generator 108 also can analyze animage included in the data 110 to identify one or more salient regionswithin the image and/or one or more invariant regions within the image.

The layout generator 108 can search the designs 112 for a design 112that matches or approximates the determined salient regions, invariantregions, and/or text associated with the data 110. If no match is foundby the layout generator 108, the layout generator can scale, pan, and/orotherwise modify the image and/or text associated with the data 110 toattempt to find a match for the data 110 among the designs 112, as willbe explained in more detail below with reference to FIG. 4. The layoutgenerator 108 thus can perform an initial search of the designs 112 fora match and/or can modify the data 110 and perform subsequent searchesof the designs 112. If the layout generator 108 identifies a design 112that matches or approximates the data 110, the layout generator 108 canload the data 110 into the design 112 and generate the output 114. Ifmultiple matching designs 112 are identified, the matching designs 112can be ranked and a highest-ranked design can be selected.

During loading the data 110 into the design 112, the layout generator108 can pan, scale, scroll, and/or otherwise move an image relative tothe design 112 such that one or more salient region of the image islocated at or near a salient region placement frame 304 associated withthe particular design 112. The layout generator 108 also can locatetext, if any, at or near the text placement frame 306 associated withthe particular design 112. The layout or other output 114 can begenerated by the layout generator 108. These and other aspects of thetransformation of data into a layout will be described in more detailbelow with reference to FIGS. 4-5D.

Turning now to FIG. 4, aspects of a method 400 for creating layouts willbe described in detail. It should be understood that the operations ofthe method 400 disclosed herein are not necessarily presented in anyparticular order and that performance of some or all of the operationsin an alternative order(s) is possible and is contemplated. Theoperations have been presented in the demonstrated order for ease ofdescription and illustration. Operations may be added, omitted, and/orperformed simultaneously, without departing from the scope of theappended claims.

It also should be understood that the illustrated method 400 can beended at any time and need not be performed in its entirety. Some or alloperations of the method 400, and/or substantially equivalentoperations, can be performed by execution of computer-readableinstructions included on a computer-storage media, as defined herein.The term “computer-readable instructions,” and variants thereof, as usedin the description and claims, is used expansively herein to includeroutines, applications, application modules, program modules, programs,components, data structures, algorithms, and the like. Computer-readableinstructions can be implemented on various system configurations,including single-processor or multiprocessor systems, minicomputers,mainframe computers, personal computers, hand-held computing devices,microprocessor-based, programmable consumer electronics, combinationsthereof, and the like.

Thus, it should be appreciated that the logical operations describedherein are implemented (1) as a sequence of computer implemented acts orprogram modules running on a computing system and/or (2) asinterconnected machine logic circuits or circuit modules within thecomputing system. The implementation is a matter of choice dependent onthe performance and other requirements of the computing system.Accordingly, the logical operations described herein are referred tovariously as states, operations, structural devices, acts, or modules.These operations, structural devices, acts, and modules may beimplemented in software, in firmware, in special purpose digital logic,and any combination thereof

For purposes of illustrating and describing the concepts of the presentdisclosure, the method 400 disclosed herein is described as beingperformed by the computing device 102 via execution of one or moreapplications, modules, or other computer-executable instructions such asthe layout generator 108. Because additional or alternative devices canexecute the functionality described herein via execution of otherapplications, modules, or computer-executable instructions, it should beunderstood that this embodiment is illustrative, and should not beviewed as being limiting in any way.

The method 400 begins at operation 402, wherein the computing device 102analyzes the data 110. The data 110 can be received, retrieved, and/orotherwise obtained by the computing device 102, as explained above, froma memory or other local or remote data storage device, from a locally orremotely executing application or other software, and/or from othercomputing systems or devices such as server computers, databases, or thelike.

During the analysis of the data 110, the computing device 102 canidentify an image or other visual content included in the data 110. Ifthe data 110 does not include any visual content, the computing device102 can obtain other data 110 and/or the method 400 can end. Thecomputing device 102 can analyze the one or more images or other visualcontent included in the data 110 to identify one or more salient regionswithin the images. The computing device 102 also can identify one ormore invariant regions within the images. The computing device 102 alsocan determine if the data 110 includes text or other information forincluding in the layout or other form of the output 114. Although notshown in FIG. 4, the computing device 102 can be configured to present auser interface for obtaining text to be included in the layout. As such,the computing device 102 can be configured to prompt for and obtain thetext instead of, or in addition to, obtaining the data 110 that includesthe text and the visual content.

From operation 402, the method 400 proceeds to operation 404, whereinthe computing device 102 can determine if the data 110 matches a design112 that is available to the computing device 102. As used herein, thecomputing device 102 can determine that the data 110 “matches” a design112 if a particular design includes a salient region placement frameand/or a text placement frame that can be used with the data 110. If asalient region of an image is too big to fit in a salient regionplacement frame defined by a particular design 112, that design 112 maybe determined by the computing device 102 not to match the data 110. If,however, the salient region of the image is sized such that the salientregion of the image will fit in the salient region placement frame, theparticular design 112 may at least partially match the data 110, subjectto the determination that the invariant region of the image matches thetext placement frame defined by the design 112.

If the computing device 102 determines that a salient region of theimage matches the salient region placement frame of the design 112, andthat a text placement frame of a design 112 is located at a locationwithin the layout that is at or near an invariant region of the image(when the salient region of the image is placed at the salient regionplacement frame), the computing device 102 can determine that the design112 matches the data 110. Conversely, if a text placement frame of adesign 112 is located at a location within the layout that is not at ornear an invariant region of the image (when the salient region of theimage is placed at the salient region placement frame), the computingdevice 102 can determine that the design 112 does not match the data110.

As explained above, the computing device 102 can maintain or access alibrary of designs 112 that can be stored at the computing device 102and/or at a location remote from the computing device 102. As such, thecomputing device 102 can compare the identified salient region(s),invariant region(s), and/or instance(s) of text in the data 110 to thedesigns 112 to determine if a match exists. In addition to the specificexamples above, the computing device 102 can be configured to determinethat a match exists between the data 110 and one or more designs 112based upon various factors including, but not limited to, a number,size, scale, location, and/or orientation of salient region placementframes 304 associated with the design 112; a number, size, scale,location, and/or orientation of text placement frames 306 associatedwith the design 112; a size, scale, dimension, dimension ratio, and/ororientation of a viewport frame 302 associated with the design 112;and/or other considerations.

In some embodiments, the computing device 102 may identify one or moredesigns 112 that match the data 110. Although not shown in FIG. 4, thecomputing device 102 can be configured to compute or generate a score orother indication of a degree to which a design 112 matches the data 110for each prospective design 112. The computing device 102 can select ahighest-ranked design 112 from all considered designs 112. As such,determining that the data 110 matches a design 112 can include rankingseveral designs 112 and selecting a highest ranked design 112.

If the computing device 102 determines, in operation 404, that the data110 matches a design 112 (and/or after selecting a highest-ranked design112 among several matching designs 112), the method 400 proceeds tooperation 412, which will be described in more detail below. If thecomputing device 102 determines in operation 404 that the data 110 doesnot match a design 112, the method 400 can proceed to operation 406.

In operation 406, the computing device 102 can resize one or more imagesincluded in the data 110. In some embodiments, the computing device 102can resize the images by zooming, panning, scrolling, cropping,extending, infilling, seam carving and/or otherwise modifying size orplacement of the image in an attempt to identify a match among thedesigns 112. It should be understood that the functionality describedherein with respect to operation 406 can be iterative. In particular,the computing device 102 can be configured to evaluate different sizesand/or other modifications in an attempt to identify a match among thedesigns 112. As such, although not shown in FIG. 4, it should beunderstood that that the computing device 102 can repeat operation 406 anumber of times while attempting to identify a match among the designs112.

Similarly, the process described herein may be different for each of thedesigns 112, and as such, the computing device 102 can be configured touse different sizes and/or modifications in an attempt to match thesalient region(s) and/or the invariant region(s) of the image to thecurrently evaluated design 112. In some embodiments, the computingdevice 102 may determine in operation 404 that a salient region of theimage is sized such that a match between the data 110 and one or moredesigns 112 does not exist without modifying the image. As such, thecomputing device 102 can resize or crop the image, for example as athumbnail image, in operation 406, and the computing device 102 canagain evaluate the available designs 112 to determine if a match exists.

From operation 406, the method 400 can proceed to operation 408, whereinthe computing device 102 can determine if the data 110 as modified inoperation 406 (“modified data”) matches a design 112. It should beunderstood that the functionality of the computing device 102 shown inoperation 408 can be substantially similar to the functionality of thecomputing device 102 shown in operation 404 above, thought this is notnecessarily the case.

If the computing device 102 determines, in operation 408, that themodified data matches a design 112, the method 400 can proceed tooperation 412, which is described in more detail below. As explainedabove, operation 408 can include ranking two or more designs 112 thatmatch the modified data and selecting a highest-ranked design 112 amongseveral matching designs 112. If the computing device 102 determines, inoperation 408, that the modified data does not match a design 112, themethod 400 can proceed to operation 410.

In operation 410, the computing device 102 can adapt a design 112 for ascaled image. Although not separately illustrated in FIG. 4, thecomputing device 102 can identify a closest fit among the designs 112considered in operation 408 and adapt that design 112 for use with ascaled image, though this is not necessarily the case. In someembodiments, the computing device 102 can be configured to adapt thedesign 112 for generation of a layout or other form of output 114 inwhich the text is not overlaid on the image.

In some embodiments, the computing device 102 can scale the image, forexample as a thumbnail image or other scaled version of the image, andthe text can be placed outside of the scaled version of the image togenerate the layout or other form of the output 114. An example of thisfunctionality is illustrated and described below with reference to FIG.5D. As such, the computing device 102 can generate the output 114 evenif a match does not exist between the data 110 (or the modified data)and the designs 112. In some embodiments, the computing device 102 canoutput an adapted design for storage or usage by the computing device102, though this operation is not separately illustrated in FIG. 4.

From operation 410, the method 400 proceeds to operation 412. As notedabove, the method 400 also can proceed to operation 412 from operations404 and 408. In operation 412, the computing device 102 can load thedata 110 or the modified data into the design 112 or the adapted design.Some example embodiments of loading the data 110 into the designs 112are illustrated and described in additional detail below with referenceto FIGS. 5A-5D. Briefly, the computing device 102 can shift, pan,scroll, scale, and/or otherwise move the image such that a salientregion of the image is located at a location, relative to the viewportframe of the design 112, that corresponds to a location of a salientregion placement frame 304 of the selected design 112. Similarly, thecomputing device 102 can shift, pan, scroll, scale, and/or otherwisemove the image such that an invariant region of the image is located ata location, relative to the viewport frame of the design 112, thatcorresponds to a location of a text placement frame 306 of the selecteddesign 112. Thus, operation 412 can include moving, scaling, scrolling,and/or otherwise transforming the data 110 to match the selected design112.

Additionally, operation 412 can include loading the text into the layoutat or near a text placement frame of the selected design. It can beappreciated that location at which the text is located can correspond toan invariant region of the image. As such, loading the data 110 into thedesign 112 can include transforming the location, size, or scale of animage and adding text to the image. In some embodiments, the computingdevice 102 can be configured to prompt a user or other entity for thetext to be loaded into the layout, thought this is not separately shownin FIG. 4.

From operation 412, the method 400 proceeds to operation 414, whereinthe computing device 102 can generate the output 114. In operation 414,the computing device 102 can output the generated layout or other formof the output 114. In some embodiments, the output 114 is provided to anapplication or other software executing on the computing device 102 oron another system or device; to a storage device at or remote from thecomputing device 102; to other devices or systems; and/or the like. Fromoperation 414, the method 400 proceeds to operation 416. The method 400ends at operation 416.

Turning now to FIGS. 5A-5D, UI diagrams showing various aspects ofloading the data 110 into the designs 112 will be described according tovarious illustrative embodiments. FIG. 5A shows an illustrative screendisplay 500A generated by a device such as the computing device 102. Insome embodiments, the screen display 500A corresponds to one or more ofthe user interfaces generated by one or more applications, modules, orother software executed by the computing device 102. The screen display500A can include an application window 502 generated by the applicationor other software. Although not visible in FIG. 5A, the applicationwindow 502 can include various menus and/or options.

The application window 502 is illustrated as displaying an image 504. Itshould be understood that the extents of the image 504 can correspond tothe viewport frame of the layout to be generated by the layout generator108, as explained above, particularly with reference to FIGS. 3A-3C,though this is not necessarily the case. In particular, the extents ofthe image 504 may or may not correspond to the limits or extents of theviewport frame, in some embodiments. For purposes of illustrating anddesigning the concepts and technologies disclosed herein, the image 504corresponds to the image 200 illustrated in FIG. 2 and/or the data 110described above in FIGS. 1-4. It should be appreciated that the screendisplay 500A, the application window 502, and/or the image 504illustrated in FIG. 5A are illustrative of one example embodiment, andtherefore should not be construed as being limited in any way.

As shown in FIG. 5A, the layout generator 108 can analyze the image 504and/or other visual content included in the data 110 to identify one ormore salient regions within the visual content. In the exampleillustrated in FIG. 5A, the layout generator 108 can identify thesalient region 506 within the image 504. The salient region 506 caninclude multiple people, faces, or other subjects. It can be appreciatedthat a portion of the people or other subjects included in the image 504can correspond to the salient region 506, and that a portion of thesubjects may or may not be included in the salient region 506, dependingupon the analysis conducted by the layout generator 108. It should beunderstood that the screen display 500A is illustrative, and that theanalysis of the image 504 can occur without updating a screen display,if desired.

Referring now to FIG. 5B, a UI diagram showing additional aspects of theconcepts and technologies disclosed herein for transforming data tocreate layouts is described in detail. In particular, FIG. 5B shows ascreen display 500B generated by a device such as the computing device102 by transforming the data 110 to load the data 110 into a design 112.As explained above, particularly with reference to FIGS. 3A-4, thecomputing device 102 can evaluate one or more designs 112 to determineif a design matches the data 110 analyzed by the computing device 102.Upon identifying a design 112, and/or selecting a highest-ranked designfrom a number of matching designs 112, the computing device 102 cantransform the data 110 by loading the data 110 into the selected design112.

In FIG. 5B, the computing device 102 has shifted the image 504 such thatthe salient region 506 of the image 504 has been shifted to a locationassociated with a salient region placement frame 304 associated with aselected design 112. It should be understood that the illustratedlocation of the salient region 506 is merely illustrative and should notbe construed as being limiting in any way. Additionally, the screendisplay 500B includes a text placement region 508 (that may or may notbe displayed for a user), which can be provided for text placement inthe layout or other form of the output 114. In FIG. 5B, the viewportframe 510 also is shown. It should be understood that the limits orextents of the image 504 may or may not correspond to the viewport frame510, as explained above. It can be appreciated with reference to FIGS.5B that the placement of the salient region 506 and the text placementregion 508 can correspond to a design 112 described herein, and that theoperations for loading the data 110 into the design 112 may be invisibleto a user or other entity. As such, the illustration of these operationsis provided to illustrate and describe the concepts and technologiesdisclosed herein, and should not be construed as being limiting in anyway.

Referring now to FIG. 5C, a UI diagram showing additional aspects of theconcepts and technologies disclosed herein for transforming data 110 tocreate layouts is described in detail. In particular, FIG. 5C shows ascreen display 500C generated by a device such as the computing device102. The screen display 500C shown in FIG. 5C is illustrated asdisplaying a layout 512. It should be understood from the description ofthe concepts and technologies disclosed herein that the layout 512 cancorrespond to and/or can be included in the output 114. As shown, thedata 110 has been transformed to create the layout 512 by shifting theimage such that a salient region thereof is located such that the text514 can be accommodated within the image and within the layout 512.

It should be appreciated that the UI diagram illustrated in FIG. 5C isillustrative of one contemplated embodiment, and therefore should not beconstrued as being limited in any way. Additionally, FIG. 5C illustratesa text entry window 516 that can be displayed to allow a user or otherentity to enter the text to be added to the layout 512. Because the textcan be obtained in other ways, it should be understood that thisembodiment is illustrative, and should not be construed as beinglimiting in any way.

Referring now to FIG. 5D, a UI diagram showing additional aspects of theconcepts and technologies disclosed herein for transforming data 110 tocreate layouts is described in detail. In particular, FIG. 5D shows ascreen display 500D generated by a device such as the computing device102. The screen display 500D shown in FIG. 5D is illustrated asdisplaying an alternative embodiment of the layout 512. As shown, thedata 110 has been transformed to create the layout 512 by scaling andshifting the image and/or by adapting a design to accommodate the scaledand shifted image and the text included in the data 110. As such, thescaled and shifted image can be located such that the text 514 can beaccommodated within the layout 512 at a location that does not overlayor overlap the image 504. As such, a layout 512 can be generated, evenif a design 112 does not match the data 110 as described in detail abovewith reference to FIG. 4.

FIG. 6 illustrates an illustrative computer architecture 600 for adevice capable of executing the software components described herein fortransforming data to create layouts. Thus, the computer architecture 600illustrated in FIG. 6 illustrates an architecture for a server computer,mobile phone, a PDA, a smart phone, a desktop computer, a netbookcomputer, a tablet computer, and/or a laptop computer. The computerarchitecture 600 may be utilized to execute any aspects of the softwarecomponents presented herein.

The computer architecture 600 illustrated in FIG. 6 includes a centralprocessing unit 602 (“CPU”), a system memory 604, including a randomaccess memory 606 (“RAM”) and a read-only memory (“ROM”) 608, and asystem bus 610 that couples the memory 604 to the CPU 602. A basicinput/output system containing the basic routines that help to transferinformation between elements within the computer architecture 600, suchas during startup, is stored in the ROM 608. The computer architecture600 further includes a mass storage device 612 for storing the operatingsystem 106 and one or more application programs including, but notlimited to, the layout generator 108 and/or other application programs(not illustrated). The mass storage device 612 also can be configured tostore the designs 112, if desired.

The mass storage device 612 is connected to the CPU 602 through a massstorage controller (not shown) connected to the bus 610. The massstorage device 612 and its associated computer-readable media providenon-volatile storage for the computer architecture 600. Although thedescription of computer-readable media contained herein refers to a massstorage device, such as a hard disk or CD-ROM drive, it should beappreciated by those skilled in the art that computer-readable media canbe any available computer storage media or communication media that canbe accessed by the computer architecture 600.

Communication media includes computer readable instructions, datastructures, program modules, or other data in a modulated data signalsuch as a carrier wave or other transport mechanism and includes anydelivery media. The term “modulated data signal” means a signal that hasone or more of its characteristics changed or set in a manner as toencode information in the signal. By way of example, and not limitation,communication media includes wired media such as a wired network ordirect-wired connection, and wireless media such as acoustic, RF,infrared and other wireless media. Combinations of the any of the aboveshould also be included within the scope of computer-readable media.

By way of example, and not limitation, computer storage media mayinclude volatile and non-volatile, removable and non-removable mediaimplemented in any method or technology for storage of information suchas computer-readable instructions, data structures, program modules orother data. For example, computer media includes, but is not limited to,RAM, ROM, EPROM, EEPROM, flash memory or other solid state memorytechnology, CD-ROM, digital versatile disks (“DVD”), HD-DVD, BLU-RAY, orother optical storage, magnetic cassettes, magnetic tape, magnetic diskstorage or other magnetic storage devices, or any other medium which canbe used to store the desired information and which can be accessed bythe computer architecture 600. For purposes the claims, the phrase“computer storage medium” and variations thereof, does not includewaves, signals, and/or other transitory and/or intangible communicationmedia, per se.

According to various embodiments, the computer architecture 600 mayoperate in a networked environment using logical connections to remotecomputers through a network such as the network 104. The computerarchitecture 600 may connect to the network 104 through a networkinterface unit 614 connected to the bus 610. It should be appreciatedthat the network interface unit 614 also may be utilized to connect toother types of networks and remote computer systems, for example thedata source 116 illustrated in FIG. 1, local or remote data storagedevices, local or remote systems or networks, or the like. The computerarchitecture 600 also may include an input/output controller 616 forreceiving and processing input from a number of other devices, includinga keyboard, mouse, or electronic stylus (not shown in FIG. 6).Similarly, the input/output controller 616 may provide output to adisplay screen, a printer, or other type of output device (also notshown in FIG. 6).

It should be appreciated that the software components described hereinmay, when loaded into the CPU 602 and executed, transform the CPU 602and the overall computer architecture 600 from a general-purposecomputing system into a special-purpose computing system customized tofacilitate the functionality presented herein. The CPU 602 may beconstructed from any number of transistors or other discrete circuitelements, which may individually or collectively assume any number ofstates. More specifically, the CPU 602 may operate as a finite-statemachine, in response to executable instructions contained within thesoftware modules disclosed herein. These computer-executableinstructions may transform the CPU 602 by specifying how the CPU 602transitions between states, thereby transforming the transistors orother discrete hardware elements constituting the CPU 602.

Encoding the software modules presented herein also may transform thephysical structure of the computer-readable media presented herein. Thespecific transformation of physical structure may depend on variousfactors, in different implementations of this description. Examples ofsuch factors may include, but are not limited to, the technology used toimplement the computer-readable media, whether the computer-readablemedia is characterized as primary or secondary storage, and the like.For example, if the computer-readable media is implemented assemiconductor-based memory, the software disclosed herein may be encodedon the computer-readable media by transforming the physical state of thesemiconductor memory. For example, the software may transform the stateof transistors, capacitors, or other discrete circuit elementsconstituting the semiconductor memory. The software also may transformthe physical state of such components in order to store data thereupon.

As another example, the computer-readable media disclosed herein may beimplemented using magnetic or optical technology. In suchimplementations, the software presented herein may transform thephysical state of magnetic or optical media, when the software isencoded therein. These transformations may include altering the magneticcharacteristics of particular locations within given magnetic media.These transformations also may include altering the physical features orcharacteristics of particular locations within given optical media, tochange the optical characteristics of those locations. Othertransformations of physical media are possible without departing fromthe scope and spirit of the present description, with the foregoingexamples provided only to facilitate this discussion.

In light of the above, it should be appreciated that many types ofphysical transformations take place in the computer architecture 600 inorder to store and execute the software components presented herein. Italso should be appreciated that the computer architecture 600 mayinclude other types of computing devices, including hand-held computers,embedded computer systems, personal digital assistants, and other typesof computing devices known to those skilled in the art. It is alsocontemplated that the computer architecture 600 may not include all ofthe components shown in FIG. 6, may include other components that arenot explicitly shown in FIG. 6, or may utilize an architecturecompletely different than that shown in FIG. 6.

FIG. 7 illustrates an illustrative distributed computing environment 700capable of executing the software components described herein fortransforming data to create layouts. Thus, the distributed computingenvironment 700 illustrated in FIG. 7 can be used to provide thefunctionality described herein with respect to the computing device 102.The distributed computing environment 700 thus may be utilized toexecute any aspects of the software components presented herein.

According to various implementations, the distributed computingenvironment 700 includes a computing environment 702 operating on, incommunication with, or as part of the network 704. The network 704 alsocan include various access networks. According to variousimplementations, the functionality of the network 704 can be provided bythe network 104 illustrated in FIG. 1.> One or more client devices706A-706N (hereinafter referred to collectively and/or generically as“clients 706”) can communicate with the computing environment 702 viathe network 704 and/or other connections (not illustrated in FIG. 7). Inthe illustrated embodiment, the clients 706 include a computing device706A such as a laptop computer, a desktop computer, or other computingdevice; a slate or tablet computing device (“tablet computing device”)706B; a mobile computing device 706C such as a mobile telephone, a smartphone, or other mobile computing device; a server computer 706D; and/orother devices 706N. It should be understood that any number of clients706 can communicate with the computing environment 702. Two examplecomputing architectures for the clients 706 are illustrated anddescribed herein with reference to FIGS. 6 and 8. It should beunderstood that the illustrated clients 706 and computing architecturesillustrated and described herein are illustrative, and should not beconstrued as being limited in any way.

In the illustrated embodiment, the computing environment 702 includesapplication servers 708, data storage 710, and one or more networkinterfaces 712. According to various implementations, the functionalityof the application servers 708 can be provided by one or more servercomputers that are executing as part of, or in communication with, thenetwork 704. The application servers 708 can host various services,virtual machines, portals, and/or other resources. In the illustratedembodiment, the application servers 708 host one or more virtualmachines 714 for hosting applications or other functionality. Accordingto various implementations, the virtual machines 714 host one or moreapplications and/or software modules for providing the functionalitydescribed herein for transforming data to create layouts. It should beunderstood that this embodiment is illustrative, and should not beconstrued as being limiting in any way. The application servers 708 alsohost or provide access to one or more Web portals, link pages, Websites, and/or other information (“Web portals”) 716.

According to various implementations, the application servers 708 alsoinclude one or more mailbox services 718 and one or more messagingservices 720. The mailbox services 718 can include electronic mail(“email”) services. The mailbox services 718 also can include variouspersonal information management (“PIM”) services including, but notlimited to, calendar services, contact management services,collaboration services, and/or other services. The messaging services720 can include, but are not limited to, instant messaging services,chat services, forum services, and/or other communication services.

The application servers 708 also can include one or more socialnetworking services 722. The social networking services 722 can includevarious social networking services including, but not limited to,services for sharing or posting status updates, instant messages, links,photos, videos, and/or other information; services for commenting ordisplaying interest in articles, products, blogs, or other resources;and/or other services. In some embodiments, the social networkingservices 722 are provided by or include the FACEBOOK social networkingservice, the LINKEDIN professional networking service, the MYSPACEsocial networking service, the FOURSQUARE geographic networking service,the YAMMER office colleague networking service, and the like. In otherembodiments, the social networking services 722 are provided by otherservices, sites, and/or providers that may or may not explicitly beknown as social networking providers. For example, some web sites allowusers to interact with one another via email, chat services, and/orother means during various activities and/or contexts such as readingpublished articles, commenting on goods or services, publishing,collaboration, gaming, and the like. Examples of such services include,but are not limited to, the WINDOWS LIVE service and the XBOX LIVEservice from Microsoft Corporation in Redmond, Wash. Other services arepossible and are contemplated.

The social networking services 722 also can include commenting,blogging, and/or microblogging services. Examples of such servicesinclude, but are not limited to, the YELP commenting service, the KUDZUreview service, the OFFICETALK enterprise microblogging service, theTWITTER messaging service, the GOOGLE BUZZ service, and/or otherservices. It should be appreciated that the above lists of services arenot exhaustive and that numerous additional and/or alternative socialnetworking services 722 are not mentioned herein for the sake ofbrevity. As such, the above embodiments are illustrative, and should notbe construed as being limited in any way.

As shown in FIG. 7, the application servers 708 also can host otherservices, applications, portals, and/or other resources (“otherresources”) 724. The other resources 724 can include, but are notlimited to, a technology layer for providing a layout generationservice, a data transformation service, or the like. It thus can beappreciated that the computing environment 702 can provide integrationof the concepts and technologies disclosed herein provided herein fortransforming data to create layouts with various mailbox, messaging,social networking, and/or other services or resources. For example, theconcepts and technologies disclosed herein can be used to create layoutsincluding images and text for social networking updates, realtimemessages, status updates, or the like. The layouts or other output 114also can be exported to a mail program, if desired, directly from thecomputing device 102.

As mentioned above, the computing environment 702 can include the datastorage 710. According to various implementations, the functionality ofthe data storage 710 is provided by one or more databases operating on,or in communication with, the network 704. The functionality of the datastorage 710 also can be provided by one or more server computersconfigured to host data for the computing environment 702. The datastorage 710 can include, host, or provide one or more real or virtualdatastores 726A-726N (hereinafter referred to collectively and/orgenerically as “datastores 726”). The datastores 726 are configured tohost data used or created by the application servers 708 and/or otherdata. Although not illustrated in FIG. 7, the datastores 726 also canhost or store the designs 112, the output 114, and/or other data used orgenerated by the layout generator 108 and/or the computing device 102.

The computing environment 702 can communicate with, or be accessed by,the network interfaces 712. The network interfaces 712 can includevarious types of network hardware and software for supportingcommunications between two or more computing devices including, but notlimited to, the clients 706 and the application servers 708. It shouldbe appreciated that the network interfaces 712 also may be utilized toconnect to other types of networks and/or computer systems.

It should be understood that the distributed computing environment 700described herein can provide any aspects of the software elementsdescribed herein with any number of virtual computing resources and/orother distributed computing functionality that can be configured toexecute any aspects of the software components disclosed herein.According to various implementations of the concepts and technologiesdisclosed herein, the distributed computing environment 700 provides thesoftware functionality described herein as a service to the clients 706.It should be understood that the clients 706 can include real or virtualmachines including, but not limited to, server computers, web servers,personal computers, mobile computing devices, smart phones, and/or otherdevices. As such, various embodiments of the concepts and technologiesdisclosed herein enable any device configured to access the distributedcomputing environment 700 to utilize the functionality described hereinfor transforming data to create layouts.

Turning now to FIG. 8, an illustrative computing device architecture 800for a computing device that is capable of executing various softwarecomponents described herein for transforming data to create layouts. Thecomputing device architecture 800 is applicable to computing devicesthat facilitate mobile computing due, in part, to form factor, wirelessconnectivity, and/or battery-powered operation. In some embodiments, thecomputing devices include, but are not limited to, mobile telephones,tablet devices, slate devices, portable video game devices, and thelike. Moreover, the computing device architecture 800 is applicable toany of the clients 806 shown in FIG. 7. Furthermore, aspects of thecomputing device architecture 800 may be applicable to traditionaldesktop computers, portable computers (e.g., laptops, notebooks,ultra-portables, and netbooks), server computers, and other computersystems, such as described herein with reference to FIG. 6. For example,the single touch and multi-touch aspects disclosed herein below may beapplied to desktop computers that utilize a touchscreen or some othertouch-enabled device, such as a touch-enabled track pad or touch-enabledmouse.

The computing device architecture 800 illustrated in FIG. 8 includes aprocessor 802, memory components 804, network connectivity components806, sensor components 808, input/output components 810, and powercomponents 812. In the illustrated embodiment, the processor 802 is incommunication with the memory components 804, the network connectivitycomponents 806, the sensor components 808, the input/output (“I/O”)components 810, and the power components 812. Although no connectionsare shown between the individuals components illustrated in FIG. 8, thecomponents can interact to carry out device functions. In someembodiments, the components are arranged so as to communicate via one ormore busses (not shown).

The processor 802 includes a central processing unit (“CPU”) configuredto process data, execute computer-executable instructions of one or moreapplication programs, and communicate with other components of thecomputing device architecture 800 in order to perform variousfunctionality described herein. The processor 802 may be utilized toexecute aspects of the software components presented herein and,particularly, those that utilize, at least in part, a touch-enabledinput.

In some embodiments, the processor 802 includes a graphics processingunit (“GPU”) configured to accelerate operations performed by the CPU,including, but not limited to, operations performed by executinggeneral-purpose scientific and engineering computing applications, aswell as graphics-intensive computing applications such as highresolution video (e.g., 720p, 1080p, and greater), video games,three-dimensional (“3D”) modeling applications, and the like. In someembodiments, the processor 802 is configured to communicate with adiscrete GPU (not shown). In any case, the CPU and GPU may be configuredin accordance with a co-processing CPU/GPU computing model, wherein thesequential part of an application executes on the CPU and thecomputationally-intensive part is accelerated by the GPU.

In some embodiments, the processor 802 is, or is included in, asystem-on-chip (“SoC”) along with one or more of the other componentsdescribed herein below. For example, the SoC may include the processor802, a GPU, one or more of the network connectivity components 806, andone or more of the sensor components 808. In some embodiments, theprocessor 802 is fabricated, in part, utilizing a package-on-package(“PoP”) integrated circuit packaging technique. Moreover, the processor802 may be a single core or multi-core processor.

The processor 802 may be created in accordance with an ARM architecture,available for license from ARM HOLDINGS of Cambridge, United Kingdom.Alternatively, the processor 802 may be created in accordance with anx86 architecture, such as is available from INTEL CORPORATION ofMountain View, Calif. and others. In some embodiments, the processor 802is a SNAPDRAGON SoC, available from QUALCOMM of San Diego, Calif., aTEGRA SoC, available from NVIDIA of Santa Clara, Calif., a HUMMINGBIRDSoC, available from SAMSUNG of Seoul, South Korea, an Open MultimediaApplication Platform (“OMAP”) SoC, available from TEXAS INSTRUMENTS ofDallas, Tex., a customized version of any of the above SoCs, or aproprietary SoC.

The memory components 804 include a random access memory (“RAM”) 814, aread-only memory (“ROM”) 816, an integrated storage memory (“integratedstorage”) 818, and a removable storage memory (“removable storage”) 820.In some embodiments, the RAM 814 or a portion thereof, the ROM 816 or aportion thereof, and/or some combination the RAM 814 and the ROM 816 isintegrated in the processor 802. In some embodiments, the ROM 816 isconfigured to store a firmware, an operating system or a portion thereof(e.g., operating system kernel), and/or a bootloader to load anoperating system kernel from the integrated storage 818 or the removablestorage 820.

The integrated storage 818 can include a solid-state memory, a harddisk, or a combination of solid-state memory and a hard disk. Theintegrated storage 818 may be soldered or otherwise connected to a logicboard upon which the processor 802 and other components described hereinalso may be connected. As such, the integrated storage 818 is integratedin the computing device. The integrated storage 818 is configured tostore an operating system or portions thereof, application programs,data, and other software components described herein.

The removable storage 820 can include a solid-state memory, a hard disk,or a combination of solid-state memory and a hard disk. In someembodiments, the removable storage 820 is provided in lieu of theintegrated storage 818. In other embodiments, the removable storage 820is provided as additional optional storage. In some embodiments, theremovable storage 820 is logically combined with the integrated storage818 such that the total available storage is made available and shown toa user as a total combined capacity of the integrated storage 818 andthe removable storage 820.

The removable storage 820 is configured to be inserted into a removablestorage memory slot (not shown) or other mechanism by which theremovable storage 820 is inserted and secured to facilitate a connectionover which the removable storage 820 can communicate with othercomponents of the computing device, such as the processor 802. Theremovable storage 820 may be embodied in various memory card formatsincluding, but not limited to, PC card, CompactFlash card, memory stick,secure digital (“SD”), miniSD, microSD, universal integrated circuitcard (“UICC”) (e.g., a subscriber identity module (“SIM”) or universalSIM (“USIM”)), a proprietary format, or the like.

It can be understood that one or more of the memory components 804 canstore an operating system. According to various embodiments, theoperating system includes, but is not limited to, SYMBIAN OS fromSYMBIAN LIMITED, WINDOWS MOBILE OS from Microsoft Corporation ofRedmond, Wash., WINDOWS PHONE OS from Microsoft Corporation, WINDOWSfrom Microsoft Corporation, PALM WEBOS from Hewlett-Packard Company ofPalo Alto, Calif., BLACKBERRY OS from Research In Motion Limited ofWaterloo, Ontario, Canada, IOS from Apple Inc. of Cupertino, Calif., andANDROID OS from Google Inc. of Mountain View, Calif. Other operatingsystems are contemplated.

The network connectivity components 806 include a wireless wide areanetwork component (“WWAN component”) 822, a wireless local area networkcomponent (“WLAN component”) 824, and a wireless personal area networkcomponent (“WPAN component”) 826. The network connectivity components806 facilitate communications to and from a network 828, which may be aWWAN, a WLAN, or a WPAN. Although a single network 828 is illustrated,the network connectivity components 806 may facilitate simultaneouscommunication with multiple networks. For example, the networkconnectivity components 806 may facilitate simultaneous communicationswith multiple networks via one or more of a WWAN, a WLAN, or a WPAN.

In some embodiments, the functionality of the network 828 can beprovided by the network 104 and/or the network 704. In some embodiments,the network 828 includes the network 104 and/or the network 704. Inother embodiments, the network 828 can be configured to provide accessto the network 104 and/or the network 704.

The network 828 may be a WWAN, such as a mobile telecommunicationsnetwork utilizing one or more mobile telecommunications technologies toprovide voice and/or data services to a computing device utilizing thecomputing device architecture 800 via the WWAN component 822. The mobiletelecommunications technologies can include, but are not limited to,Global System for Mobile communications (“GSM”), Code Division MultipleAccess (“CDMA”) ONE, CDMA2000, Universal Mobile TelecommunicationsSystem (“UMTS”), Long Term Evolution (“LTE”), and WorldwideInteroperability for Microwave Access (“WiMAX”). Moreover, the network828 may utilize various channel access methods (which may or may not beused by the aforementioned standards) including, but not limited to,Time Division Multiple Access (“TDMA”), Frequency Division MultipleAccess (“FDMA”), CDMA, wideband CDMA (“W-CDMA”), Orthogonal FrequencyDivision Multiplexing (“OFDM”), Space Division Multiple Access (“SDMA”),and the like. Data communications may be provided using General PacketRadio Service (“GPRS”), Enhanced Data rates for Global Evolution(“EDGE”), the High-Speed Packet Access (“HSPA”) protocol familyincluding High-Speed Downlink Packet Access (“HSDPA”), Enhanced Uplink(“EUL”) or otherwise termed High-Speed Uplink Packet Access (“HSUPA”),Evolved HSPA (“HSPA+”), LTE, and various other current and futurewireless data access standards. The network 828 may be configured toprovide voice and/or data communications with any combination of theabove technologies. The network 828 may be configured to or adapted toprovide voice and/or data communications in accordance with futuregeneration technologies.

In some embodiments, the WWAN component 822 is configured to providedual-multi-mode connectivity to the network 828. For example, the WWANcomponent 822 may be configured to provide connectivity to the network828, wherein the network 828 provides service via GSM and UMTStechnologies, or via some other combination of technologies.Alternatively, multiple WWAN components 822 may be utilized to performsuch functionality, and/or provide additional functionality to supportother non-compatible technologies (i.e., incapable of being supported bya single WWAN component). The WWAN component 822 may facilitate similarconnectivity to multiple networks (e.g., a UMTS network and an LTEnetwork).

The network 828 may be a WLAN operating in accordance with one or moreInstitute of Electrical and Electronic Engineers (“IEEE”) 802.11standards, such as IEEE 802.11a, 802.11b, 802.11g, 802.11n, and/orfuture 802.11 standard (referred to herein collectively as WI-FI). Draft802.11 standards are also contemplated. In some embodiments, the WLAN isimplemented utilizing one or more wireless WI-FI access points. In someembodiments, one or more of the wireless WI-FI access points are anothercomputing device with connectivity to a WWAN that are functioning as aWI-FI hotspot. The WLAN component 824 is configured to connect to thenetwork 828 via the WI-FI access points. Such connections may be securedvia various encryption technologies including, but not limited, WI-FIProtected Access (“WPA”), WPA2, Wired Equivalent Privacy (“WEP”), andthe like.

The network 828 may be a WPAN operating in accordance with Infrared DataAssociation (“IrDA”), BLUETOOTH, wireless Universal Serial Bus (“USB”),Z-Wave, ZIGBEE, or some other short-range wireless technology. In someembodiments, the WPAN component 826 is configured to facilitatecommunications with other devices, such as peripherals, computers, orother computing devices via the WPAN.

The sensor components 808 include a magnetometer 830, an ambient lightsensor 832, a proximity sensor 834, an accelerometer 836, a gyroscope838, and a Global Positioning System sensor (“GPS sensor”) 840. It iscontemplated that other sensors, such as, but not limited to,temperature sensors or shock detection sensors, also may be incorporatedin the computing device architecture 800.

The magnetometer 830 is configured to measure the strength and directionof a magnetic field. In some embodiments the magnetometer 830 providesmeasurements to a compass application program stored within one of thememory components 804 in order to provide a user with accuratedirections in a frame of reference including the cardinal directions,north, south, east, and west. Similar measurements may be provided to anavigation application program that includes a compass component. Otheruses of measurements obtained by the magnetometer 830 are contemplated.

The ambient light sensor 832 is configured to measure ambient light. Insome embodiments, the ambient light sensor 832 provides measurements toan application program stored within one the memory components 804 inorder to automatically adjust the brightness of a display (describedbelow) to compensate for low-light and high-light environments. Otheruses of measurements obtained by the ambient light sensor 832 arecontemplated.

The proximity sensor 834 is configured to detect the presence of anobject or thing in proximity to the computing device without directcontact. In some embodiments, the proximity sensor 834 detects thepresence of a user's body (e.g., the user's face) and provides thisinformation to an application program stored within one of the memorycomponents 804 that utilizes the proximity information to enable ordisable some functionality of the computing device. For example, atelephone application program may automatically disable a touchscreen(described below) in response to receiving the proximity information sothat the user's face does not inadvertently end a call or enable/disableother functionality within the telephone application program during thecall. Other uses of proximity as detected by the proximity sensor 834are contemplated.

The accelerometer 836 is configured to measure proper acceleration. Insome embodiments, output from the accelerometer 836 is used by anapplication program as an input mechanism to control some functionalityof the application program. For example, the application program may bea video game in which a character, a portion thereof, or an object ismoved or otherwise manipulated in response to input received via theaccelerometer 836. In some embodiments, output from the accelerometer836 is provided to an application program for use in switching betweenlandscape and portrait modes, calculating coordinate acceleration, ordetecting a fall. Other uses of the accelerometer 836 are contemplated.

The gyroscope 838 is configured to measure and maintain orientation. Insome embodiments, output from the gyroscope 838 is used by anapplication program as an input mechanism to control some functionalityof the application program. For example, the gyroscope 838 can be usedfor accurate recognition of movement within a 3D environment of a videogame application or some other application. In some embodiments, anapplication program utilizes output from the gyroscope 838 and theaccelerometer 836 to enhance control of some functionality of theapplication program. Other uses of the gyroscope 838 are contemplated.

The GPS sensor 840 is configured to receive signals from GPS satellitesfor use in calculating a location. The location calculated by the GPSsensor 840 may be used by any application program that requires orbenefits from location information. For example, the location calculatedby the GPS sensor 840 may be used with a navigation application programto provide directions from the location to a destination or directionsfrom the destination to the location. Moreover, the GPS sensor 840 maybe used to provide location information to an external location-basedservice, such as E911 service. The GPS sensor 840 may obtain locationinformation generated via WI-FI, WIMAX, and/or cellular triangulationtechniques utilizing one or more of the network connectivity components806 to aid the GPS sensor 840 in obtaining a location fix. The GPSsensor 840 may also be used in Assisted GPS (“A-GPS”) systems.

The I/O components 810 include a display 842, a touchscreen 844, a dataI/O interface component (“data I/O”)846, an audio I/O interfacecomponent (“audio I/O”) 848, a video I/O interface component (“videoI/O”) 850, and a camera 852. In some embodiments, the display 842 andthe touchscreen 844 are combined. In some embodiments two or more of thedata I/O component 846, the audio I/O component 848, and the video I/Ocomponent 850 are combined. The I/O components 810 may include discreteprocessors configured to support the various interface described below,or may include processing functionality built-in to the processor 802.

The display 842 is an output device configured to present information ina visual form. In particular, the display 842 may present graphical userinterface (“GUI”) elements, text, images, video, notifications, virtualbuttons, virtual keyboards, messaging data, Internet content, devicestatus, time, date, calendar data, preferences, map information,location information, and any other information that is capable of beingpresented in a visual form. In some embodiments, the display 842 is aliquid crystal display (“LCD”) utilizing any active or passive matrixtechnology and any backlighting technology (if used). In someembodiments, the display 842 is an organic light emitting diode (“OLED”)display. Other display types are contemplated.

The touchscreen 844 is an input device configured to detect the presenceand location of a touch. The touchscreen 844 may be a resistivetouchscreen, a capacitive touchscreen, a surface acoustic wavetouchscreen, an infrared touchscreen, an optical imaging touchscreen, adispersive signal touchscreen, an acoustic pulse recognitiontouchscreen, or may utilize any other touchscreen technology. In someembodiments, the touchscreen 844 is incorporated on top of the display842 as a transparent layer to enable a user to use one or more touchesto interact with objects or other information presented on the display842. In other embodiments, the touchscreen 844 is a touch padincorporated on a surface of the computing device that does not includethe display 842. For example, the computing device may have atouchscreen incorporated on top of the display 842 and a touch pad on asurface opposite the display 842.

In some embodiments, the touchscreen 844 is a single-touch touchscreen.In other embodiments, the touchscreen 844 is a multi-touch touchscreen.In some embodiments, the touchscreen 844 is configured to detectdiscrete touches, single touch gestures, and/or multi-touch gestures.These are collectively referred to herein as gestures for convenience.Several gestures will now be described. It should be understood thatthese gestures are illustrative and are not intended to limit the scopeof the appended claims. Moreover, the described gestures, additionalgestures, and/or alternative gestures may be implemented in software foruse with the touchscreen 844. As such, a developer may create gesturesthat are specific to a particular application program.

In some embodiments, the touchscreen 844 supports a tap gesture in whicha user taps the touchscreen 844 once on an item presented on the display842. The tap gesture may be used for various reasons including, but notlimited to, opening or launching whatever the user taps. In someembodiments, the touchscreen 844 supports a double tap gesture in whicha user taps the touchscreen 844 twice on an item presented on thedisplay 842. The double tap gesture may be used for various reasonsincluding, but not limited to, zooming in or zooming out in stages. Insome embodiments, the touchscreen 844 supports a tap and hold gesture inwhich a user taps the touchscreen 844 and maintains contact for at leasta pre-defined time. The tap and hold gesture may be used for variousreasons including, but not limited to, opening a context-specific menu.

In some embodiments, the touchscreen 844 supports a pan gesture in whicha user places a finger on the touchscreen 844 and maintains contact withthe touchscreen 844 while moving the finger on the touchscreen 844. Thepan gesture may be used for various reasons including, but not limitedto, moving through screens, images, or menus at a controlled rate.Multiple finger pan gestures are also contemplated. In some embodiments,the touchscreen 844 supports a flick gesture in which a user swipes afinger in the direction the user wants the screen to move. The flickgesture may be used for various reasons including, but not limited to,scrolling horizontally or vertically through menus or pages. In someembodiments, the touchscreen 844 supports a pinch and stretch gesture inwhich a user makes a pinching motion with two fingers (e.g., thumb andforefinger) on the touchscreen 844 or moves the two fingers apart. Thepinch and stretch gesture may be used for various reasons including, butnot limited to, zooming gradually in or out of a website, map, orpicture.

Although the above gestures have been described with reference to theuse one or more fingers for performing the gestures, other appendagessuch as toes or objects such as styluses may be used to interact withthe touchscreen 844. As such, the above gestures should be understood asbeing illustrative and should not be construed as being limiting in anyway.

The data I/O interface component 846 is configured to facilitate inputof data to the computing device and output of data from the computingdevice. In some embodiments, the data I/O interface component 846includes a connector configured to provide wired connectivity betweenthe computing device and a computer system, for example, forsynchronization operation purposes. The connector may be a proprietaryconnector or a standardized connector such as USB, micro-USB, mini-USB,or the like. In some embodiments, the connector is a dock connector fordocking the computing device with another device such as a dockingstation, audio device (e.g., a digital music player), or video device.

The audio I/O interface component 848 is configured to provide audioinput and/or output capabilities to the computing device. In someembodiments, the audio I/O interface component 846 includes a microphoneconfigured to collect audio signals. In some embodiments, the audio I/Ointerface component 846 includes a headphone jack configured to provideconnectivity for headphones or other external speakers. In someembodiments, the audio interface component 848 includes a speaker forthe output of audio signals. In some embodiments, the audio I/Ointerface component 846 includes an optical audio cable out.

The video I/O interface component 850 is configured to provide videoinput and/or output capabilities to the computing device. In someembodiments, the video I/O interface component 850 includes a videoconnector configured to receive video as input from another device(e.g., a video media player such as a DVD or BLURAY player) or sendvideo as output to another device (e.g., a monitor, a television, orsome other external display). In some embodiments, the video I/Ointerface component 850 includes a High-Definition Multimedia Interface(“HDMI”), mini-HDMI, micro-HDMI, DisplayPort, or proprietary connectorto input/output video content. In some embodiments, the video I/Ointerface component 850 or portions thereof is combined with the audioI/O interface component 848 or portions thereof.

The camera 852 can be configured to capture still images and/or video.The camera 852 may utilize a charge coupled device (“CCD”) or acomplementary metal oxide semiconductor (“CMOS”) image sensor to captureimages. In some embodiments, the camera 852 includes a flash to aid intaking pictures in low-light environments. Settings for the camera 852may be implemented as hardware or software buttons.

Although not illustrated, one or more hardware buttons may also beincluded in the computing device architecture 800. The hardware buttonsmay be used for controlling some operational aspect of the computingdevice. The hardware buttons may be dedicated buttons or multi-usebuttons. The hardware buttons may be mechanical or sensor-based.

The illustrated power components 812 include one or more batteries 854,which can be connected to a battery gauge 856. The batteries 854 may berechargeable or disposable. Rechargeable battery types include, but arenot limited to, lithium polymer, lithium ion, nickel cadmium, and nickelmetal hydride. Each of the batteries 854 may be made of one or morecells.

The battery gauge 856 can be configured to measure battery parameterssuch as current, voltage, and temperature. In some embodiments, thebattery gauge 856 is configured to measure the effect of a battery'sdischarge rate, temperature, age and other factors to predict remaininglife within a certain percentage of error. In some embodiments, thebattery gauge 856 provides measurements to an application program thatis configured to utilize the measurements to present useful powermanagement data to a user. Power management data may include one or moreof a percentage of battery used, a percentage of battery remaining, abattery condition, a remaining time, a remaining capacity (e.g., in watthours), a current draw, and a voltage.

The power components 812 may also include a power connector, which maybe combined with one or more of the aforementioned I/O components 810.The power components 812 may interface with an external power system orcharging equipment via a power I/O component 844.

Based on the foregoing, it should be appreciated that technologies fortransforming data to create layouts have been disclosed herein. Althoughthe subject matter presented herein has been described in languagespecific to computer structural features, methodological andtransformative acts, specific computing machinery, and computer readablemedia, it is to be understood that the invention defined in the appendedclaims is not necessarily limited to the specific features, acts, ormedia described herein. Rather, the specific features, acts and mediumsare disclosed as example forms of implementing the claims.

The subject matter described above is provided by way of illustrationonly and should not be construed as limiting. Various modifications andchanges may be made to the subject matter described herein withoutfollowing the example embodiments and applications illustrated anddescribed, and without departing from the true spirit and scope of thepresent invention, which is set forth in the following claims.

We claim:
 1. A computer-implemented method for transforming data togenerate a layout, the computer-implemented method comprising performingcomputer-implemented operations for: executing a layout generator at acomputing device to obtain the data, the data comprising an image and atleast one of text or another element of content; analyzing the image,using the layout generator, to identify a salient region of the image;selecting, based at least partially upon the data, a design comprising aviewport frame, a salient region placement frame, and a text placementframe; moving or cropping the image such that the salient region of theimage is located at a location within a layout that corresponds to thesalient region placement frame of the design; placing the text or theother element of content at a location within the layout thatcorresponds to a location of the text placement frame within the design;and generating the layout comprising at least a portion of the image andat least a portion of the text.
 2. The method of claim 1, whereinselecting the design comprises: comparing the data to one or moredesigns; determining that the image can be moved or cropped such thatthe placement of the salient region matches the salient region placementof the design; and selecting the design.
 3. The method of claim 1,wherein selecting the design comprises: comparing the data to multipledesigns stored at the computing device; for each design, determining ifthe image can be moved or cropped to match placement of the salientregion with the placement of the salient region in the design;identifying, based upon the determining, that two or more designs matchthe data; ranking the two or more designs; and selecting a highestranked design of the two or more designs.
 4. The method of claim 1,wherein selecting the design comprises: comparing the data to one ormore designs; determining that a design does not include a salientregion placement frame that matches the salient region of the image;resizing the image to generate modified data; comparing the modifieddata to the one or more designs; determining that a further designincludes a salient region placement frame that matches a salient regionof the modified data; and selecting the further design.
 5. The method ofclaim 1, further comprising: analyzing the image to identify aninvariant region within the image, the invariant region comprising aportion of the image at which the text can be placed.
 6. The method ofclaim 5, wherein selecting the design comprises: comparing the data toone or more designs; determining that a design does not include a textplacement frame that matches a position of the invariant region withinthe image; resizing the image to generate a scaled version of the image;and adapting a design to incorporate the scaled version of the image andthe text in the layout, wherein the text is located at a position in thelayout at which the text does not overlay the scaled version of theimage.
 7. The method of claim 5, wherein placing the text at thelocation within the layout comprises placing the text at least partiallyover the invariant region.
 8. The method of claim 7, wherein placing thetext comprises overlaying the image with at least half of the textoverlapping the invariant region.
 9. The method of claim 1, wherein theviewport frame defines viewable limits of the layout, wherein thesalient region placement frame corresponds to a location within thelayout at which at least a portion of the salient region of the image isto be placed, and wherein the text placement frame corresponds to alocation within the layout at which at least a portion of the text is tobe placed.
 10. A computer storage medium having computer readableinstructions stored thereupon that, when executed by a computer, causethe computer to: execute a layout generator to obtain data comprisingvisual content and text; analyze the image to identify a salient regionof the image; select, based at least partially upon the data, a designdefining a layout, the design comprising a viewport frame, a salientregion placement frame, and a text placement frame; adjust a position ofthe image relative to the viewport frame to locate the salient region ofthe image at a location within the layout corresponding to the salientregion placement frame of the design; overlay the text at a locationwithin the layout that corresponds to a location of the text placementframe within the design; and generate the layout, the layout comprisingat least a portion of the image and at least a portion of the text. 11.The computer storage medium of claim 10, wherein the computer executableinstructions for adjusting the position further comprise computerexecutable instructions that, when executed by the computer, cause thecomputer to: place the image at a location within the viewport frame atwhich at least a portion of the salient region of the image is withinthe viewport frame, and at which at least a portion of the image islocated outside of the viewport frame.
 12. The computer storage mediumof claim 10, wherein the computer executable instructions for selectingthe design further comprise computer executable instructions that, whenexecuted by the computer, cause the computer to: compare the data to oneor more designs; determine that the image can be scaled or cropped suchthat the salient region of the image matches the salient regionplacement frame of at least one of the designs; and selecting at leastone of the designs.
 13. The computer storage medium of claim 10, whereinthe computer executable instructions for selecting the design furthercomprise computer executable instructions that, when executed by thecomputer, cause the computer to: compare the data to a plurality ofdesigns stored at the computing device; determining that the image canbe scaled or cropped to match placement of the salient region with theplacement of the salient region in the design, resulting in theselection of two or more designs; rank the two or more designs; andselect a highest ranked design of the two or more designs.
 14. Thecomputer storage medium of claim 10, further comprising computerexecutable instructions that, when executed by the computer, cause thecomputer to: analyze the image to identify an invariant region withinthe image, the invariant region comprising a portion of the image atwhich the text can be placed.
 15. The computer storage medium of claim14, wherein the computer executable instructions for selecting thedesign further comprise computer executable instructions that, whenexecuted by the computer, cause the computer to: compare the salientregion image and the invariant region of the image to locations ofsalient region placement frames and text placement frames of a pluralityof designs; determine that a design includes a salient region placementframe that matches the salient region, and a text placement frame thatoverlaps the invariant region; and select the design.
 16. The computerstorage medium of claim 10, wherein the computer executable instructionsfor selecting the design further comprise computer executableinstructions that, when executed by the computer, cause the computer to:compare the salient region of the image and the invariant region of theimage to locations of salient region placement frames and text placementframes of a plurality of designs; determine that the plurality ofdesigns do not include a salient region placement frame that matches thesalient region, or a text placement frame that matches the invariantregion; resize the image to generate a scaled version of the image; andadapt one of the plurality of designs to incorporate the scaled versionof the image and the text in the layout, wherein the text is located ata position in the layout at which the text does not overlay the scaledversion of the image.
 17. The computer storage medium of claim 10,wherein the salient region comprises at least a portion of the imagethat is to be included within the viewport frame of the layout.
 18. Acomputer storage medium having computer readable instructions storedthereupon that, when executed by a computer, cause the computer to:execute a layout generator to obtain data comprising visual content andtext; analyze the image to identify a salient region of the image and aninvariant region of the image, the salient region comprising at least aportion of the image that is to be visible in a layout, and theinvariant portion comprising a portion of the image at which the textcan be placed; select, based at least partially upon the data, a designdefining the layout, the design comprising a viewport frame definingvisible limits of the layout, a salient region placement framecorresponding to a location at which the salient region of the image isto be placed, and a text placement frame corresponding to a location atwhich the text is to be placed within the layout; loading the data intothe design based, at least partially, upon the salient region, theinvariant region, the salient region placement frame, and the textplacement frame; and generate the layout, the layout comprising at leasta portion of the image and at least a portion of the text.
 19. Thecomputer storage medium of claim 18, wherein the computer executableinstructions for selecting the design further comprise computerexecutable instructions that, when executed by the computer, cause thecomputer to: compare the data to a plurality of designs based upon thesalient region of the image, the invariant region of the image, andlocations of salient region placement frames and text placement framesof the plurality of designs; determine that two or more of the pluralityof designs match the data; rank the two or more designs; and select ahighest ranked design of the two or more designs.
 20. The computerstorage medium of claim 18, wherein the computer executable instructionsfor selecting the design further comprise computer executableinstructions that, when executed by the computer, cause the computer to:compare the salient region of the image and the invariant region of theimage to locations of salient region placement frames and text placementframes of a plurality of designs; determine that the plurality ofdesigns do not include a salient region placement frame that matches thesalient region, or a text placement frame that matches the invariantregion; resize the image to generate a scaled version of the image; andadapt one of the plurality of designs to incorporate the scaled versionof the image and the text in the layout, wherein the text is located ata position in the layout at which the text does not overlay the scaledversion of the image.